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In  fiaadrdaslgn  kornal  nonpar aastrlc  regression,  tbara  has 
a  paucity  of  results  for  aodals  which  allow  for  correlated  errors. 

l?«aasur«  - *  ~3 


Consider  the  following  rapeatedi^Masureaents  nodal',  applicable  In 
growth  curvw  analyslslc'Ta(at)  ■  g^)  ♦  s»l, ...,a 

(e.g., subjects),  (a. g., tine  points)  with  errors  of  aero 

naan  and  wi  thin-subject  covariance  aatrlx  £.  Nora  specifically,  wa 
assuna  that  covf«s(xt),«ll(av)]  -  ilgo(st,xT) 

Xronedcer-da 

(  ill  t*\  u.  x 

ited  as  the 

and  a  suitably  restricted 


«ra  Is  the 


**  alensnt  of  Z. 


Jtm  and  o( a^s*)  is  the  (t,v) 

/  ill  ru u. y 

Purtheraore,^it  is  assunad  that  ela^a^nay  be  rapri 


correlation  function,  y^-a*)  ?  Asymptotic  scansions  of  the  naan 

of  the  Passer  rMfiller  kernel  eetlaator  of  an  arbitrary 


pth  derivative  of  g  are  obtained  fur  two 


correlation  functions.  Consistency 


s  p-l 


results 
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Zf  onedOsires  to  estiaate  the  pth  derivative  of  g<«),  denoted 

i  :  3*:  C  •, 

glp)<*),\  it  is  natural  to  quastioo  <fcittar  g£p)(s),  tba  pth 


derivative  of  a  kernel  aatiaator  fats),  is  a  worthwhile  candidate. 
Such  estiaftors  hare  boon  tamed  "indirect"  estiaators  of  g(p)  by 
aeogfkei\kfa4c)  and  others,  let  ending  tho  notation  of  the  general 
linear  aatiaator,  let 


g^ts)  •  «££’(■>  f(a ai>,  p-0,1,2. 


(l.l) 


denote  an  estiaator  of  g(p)(«)  in  the  correlated  errors 


■  »<*t>  *  •»(«*>) 


•  •  1,2, 


t  *  1,2,..., a; 


■[•'(St)]  -  0,  all  s,t| 
[«s(st),flH(av)]  •  •Me(st,av), 


(1.2) 


will  he 


**(■)  -  ^(s)  •  (l/h)  *[(a-e)/hjia 


At  •  (•*.*••&)’  %  «  •%  *  %*t»  H  •  ••  «e  •  *• 


(1.1) 


(2.4) 
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■Slier  (1979)  It  is  island  that  the  karnal  function  X  has  finite 
support  [-r,r],  which  wo  will  always  as suaa  to  bo  [-1,1]  in  our 
traafant .  Dhlika  density  estimation,  whare  it  is  desirable  that  tha 
astinata  bo  a  density,  there  is  no  coapelling  reason  in  regression  to 
require  that  X  be  nonnogative.  No  will  continue  to  asstase  that  X  is 
syatric,  has  support  [-1,1],  and  integrates  to  one,  but  will  not 
require  nonnegativity,  in  the  case  of  foming  an  indirect  estimator 
of  g<p),  we  see  that  tins  differentiated  kernel  tens  certainly  will 
produce  weight  functions  which  are  negative  over  a  large  part  of  the 
range. 

Observe  that  the  weight  function  coefficint  corresponding  to 
the  indirect  CM  estimtor  is  obtained  by  differentiating  (1.3), 
yielding 

wJfU)  -  [tf/da**]  w<J>(a)  -  (l/h**1)  /Ai  Kp[(a-u)/h]du,  (1.5) 
Kp(u)  -  X(p)(u) 

Por  the  frieatlay-Chao  estimator  (PC),  we  observe  that 

w£j>(«)  -  (l/h?*1)  (a^j-nx)  X,[(a-ax)/h],  ».•> 

while  for  the  Wdsrsqa  NUtson  (Mr)  we  have 

wfi|>(a)  •  [dP/duH  (X[(a-ax)/h]  /  I*  X[(«-at)/h]}. 

this  last  espreesien  will  prodaoe  a  fairly  nepllnatad  indirect 


dollar  (1979)) 


Bn  priaary  goal  of  this  paper  is  to  (Udalqp  asjwptotic 
■prwlw  for  tha  variance,  bias,  ana  neon  squared  arror  of 
aatlaatora  (1.1)  with  Might*  of  Con  (1.5)  for  an  arbitrary  ardor  p 
of  tbo  derivative  to  bo  aatiaatad.  Tha  low  ordar  darivativas  ara  of 
pradwriwant  interest,  aapacially  in  growth  conra  application*.  Chao* 
far  p  ■  1  and  p  ■  2  will  ba  considered  in  nora  detail. 

da  will  oanaldar  aatiaatlon  in  tha  nodal  given  by  (1*2)  with  a 
general  correlation  function  y,  which  will  bo  a  enaction  whose 
arganant  is  tha  qpaeiag  a^-a^  of  daalgn  points.  Throaghont  this 
paper,  it  is  assMad  that 
(i)  y  is  own, 

(U)  |t(-)|  1  1, 

(ill)  y  is  real  and  conttanoas  at  0,  (1.7) 

(iv)  y(0)  -  l,  and 

(v)  7  la  a  positive  definite  faactlon. 

Vkan  propartiaa  (ill)  -  (v)  it  follows  that  7  is  a  dnractaristic 


§ 
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7<u)  ■  aup{-a|u|},  a  >  0. 

We  will  investigate  the  ramifications  of  oar  asymptotic  expressions 
with  regard  to  Man  square  consistency,  optiaal  local  bandwidth 
selection,  and  the  corresponding  rate  of  convergence  of  the  MSI. 

First  we  will  review  mm  recent  developments  in  the  estimation  of 
derivatives. 

2.  Recent  Developments 

unless  otherwise  noted,  all  references  in  this  section  deal  with  the 
traditional  fixed-design  Model  with  uncorrelated  errors, 

104)  »  gU*)  ♦  eta,,)!  t  *  l,...,n; 
a1,...,sB  are  selected  prior  to  data  collection;  and 
l[«(xt)]  •  0,  cov[«(xt),a(aa)]  ■  6tu  a*. 

Observe  that  this  Model  is  the  special  case  of  the  repeated- 
Measurements  model  (1.2)  with  a  •  1  and  unoorr elated  errors.  It 
should  be  noted,  however,  that  the  scalar  variance  term  in  the  above 
sndal  would  probably  be  attributed  to  msasurmssnt  error  and  not  to 
ssapltng  variability  in  the  subject-to-subject  response  which  is 
associated  with  a  population  of  subjects. 

tte  estimators  of  g<p>(u)  will  be  of  linear  forms 
g£p>(a)  •  Ij.j  wjj>(a)  y(a1),  p  •  0,1,... 
ubare  eft*  (a)  depends  on  the  design  points  ^,...,v  a  bsmdwidth 


*»»■* 


6 


parameter  h,  and  a  kernel  (unction  Fp.  As  in  our  development,  many 
author*  assuaa  that  tha  karnal  (unction  bat  (inita  support.  Zt  will 
bo  saan  that  tha  karnal  Mist  satisfy  othar  rastrictions  in  ordor  for 
tha  estimator  to  possess  desirable  statistical  properties. 

Schuster  and  Yakowitz  (1979)  prove  results  involving  tha  uniform 
convargonco  of  indirect  estimators  of  g(p)  for  tha  PC  astiaator  as 
specified  by  (1.6).  We  state  their  main  result. 

Thooraai  (2.1)  —  Schuster  and  Yakowitz  (1979) 

Let  K  be  a  probability  density  function  such  that 

(i)  lu1*1  K<J)(u)|  -*  0,  as  u  -♦  •,  for  J  ■  0,1, ...,p; 

(ii)  the  first  p+1  derivatives  of  K  are  continuous  and 
bounded  on  (-•,«) l  and 

(iii)  /  |up  t(u)  |du  <  •,  where  *(u)  is  the 
characteristic  function  of  K. 

Additional  suppositions  are 

(iv)  g(p+1)  ezists  and  is  continuous  on  [0,1] »  and 

(v)  i[y2;z]  S  v  (bounded  variance  for  all  z). 
than  for  every  «  >  0,  there  is  a  constant  C  >  0  such  that,  for  n 
sufficiently  large, 

l*P>GO-»(,><*>l  >  .1  <  C/.W-*1. 
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For  results  restricting  K  to  be  a  symmetric  density  for  the  case 
p-0,  consult  Chang  and  Lin  (1981a, 1981b).  Their  estimator  is  siailar 
to  that  of  Gasser  and  Muller  (1979),  who  allow  negativity  of  K. 

Gasser  and  Muller  (1984)  and  Gasser,  Muller,  and  Maamitzsch  (1985) 
extend  their  original  work  to  the  estimation  of  derivatives.  In  the 
first  peper  it  is  true  that  Kp  ■  K(p),  as  in  indirect  estimation,  but 
this  requirement  is  dropped  in  the  latter  paper  since  Kp  may  be 
chosen  freely  for  each  p,  provided  it  satisfies  a  certain  moment 
condition.  It  is  not  always  optimal  to  simply  estimate  g(p>  by  taking 
the  ptb  derivative  of  an  optimal  estimator  of  g.  The  latter  work 
explores  the  choice  of  kernel  in  a  class  of  so-called  higher  order 
kernels  that  depend  on  p.  This  is  what  Georgiev  (1984c)  terms  direct 
estimation.  The  distinction  is  not  particularly  important  since  one 
may  relate  the  conditions  which  Kp  should  satisfy  to  a  set  of 
conditions  K(-Kq)  should  satisfy  when  differentiated  p  times.  This  is 
done  in  Gasser  and  Muller  (1984).  Me  should  note,  however,  that  for  p 
of  sufficient  magnitude,  the  associated  class  of  higher-order  kernels 
may  not  admit  K(p>,  where  K  is  a  probability  density.  This  is  because 
the  moment  conditions  placed  on  K(p>  may  iaply  that  K  must  be 
negative  over  part  of  its  support. 

Gasser  and  Muller  (1964)  require  that  K  »  Kg  satisfy  the 


following  conditions t 
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(«)  K  is  a  p-tl—  dif f erantiable  function  so  that 
Kp  -  K(p>  is  defined, 

(b)  tp  has  support  [-1,1], 

(c)  /  K(u)dn  *  l,  and 

<d)  Kj(l)  -  K3(-l)  -  0  for  j  -  0,1,..., p-1. 

notice  that  the  Kpanachnlkov  kernel  K(u)  ■  (3/4) (l-ua)  would  satisfy 
condition  (d)  for  estinating  tha  first  darivativa  (p-1),  but  fail  for 
astiaating  tha  sacond  darivativa  (p-2) ,  in  which  casa  tha  saoothar 
guartic  karnal  K(u)  -  (15/16) (l-uJ)a  is  a  candidata.  Gassar, 
at  al.  (1985)  hava  shown  that,  subjact  to  car tain  conditions, 

Kx(u)  «  (15/4) (u*-u) 

is  superior  to  tha  darivativa  of  tha  Bpanachnikov, 

Kx(u)  -  Ka>(u)  -  -  (3/2)u,  (2.1) 

Insofar  as  alnlnuai  MKK  is  concamad.  Bowavar,  (2.1)  is  battar  if  ana 
is  nora  concamad  with  ■inladaatlon  of  tha  asymptotic  varlanca  than 
with  adnlnlaatlon  of  tha  asynptotic  squarad  Idas,  ttadar  thasa 
conditions  and  Lipschits  continuity  of  g,  an  asynptotic  anpansion  of 
>[fip>(s)]  is  obtainad.  this  result  will  be  used  in  later 
developnants  la  this  paper.  One  of  the  nain  results  is  the  following i 
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Theoraa  (2.2)  —  Gtiur  and  Hollar  (1984) 

Lat  g  ba  a  p-tlaaa  differentiable  function  dafinad  on  tha  Interval 
(0,1),  (whan  p-0,  as suae  continuity).  Suppose  that  Kp  -  K(p)  is 
bounded.  19m  g*p)(x)  as  pacified  by  (1.5)  is  MSB  consistent  for 
g<p)(x)  if: 

(i)  g<p)  is  continuous  at  a  in  (0,1),  and 
(ii)  h  — »  0,  nh2p+1  — *  »,  as  n  — »  ». 


The  authors  proceed  to  establish  results  on  alaost-sure  convergence 
and  asyaptotic  nornality  under  conditions  similar  to  those  in  Cheng 
and  Lin  (1981a, 1981b).  An  asyaptotic  expression  for  the  naan  squared 
error  at  a  point  is  obtained.  The  rate  of  MSS  convergence  depends 
upon  an  appropriate  choice  of  a  higher-order  kernel,  which  relates  to 
the  original  differentiated  kernel  via  the  following  laana. 

Learn  (2.1)  —  Gasser  and  Muller  (1984) 

Let  8  be  a  non-sero  constant  and  r  be  an  integer  such  that  r  k  p+2. 
Suppose  K  is  a  kernel  function  such  that 

(i)  K<J>(1)  -  K<J)(-1)  -  0  for  j-0,l,...,p-l? 

ii  1  3  "  0 

(ii)  J_x  u3  K(u)du  "0  j  ■  1, ...,r-p-l 

(-l)p  8  (r-p)l/r!  J  ■  r-p. 


(2.2) 


(2.3) 


Than  the  pth  derivative  of  K,  danotad  Kp  ■  R(p),  satisfies 

0  j  ■  0, . . . »P“1»P+1» » • .#r-l 

/_i  u3  Kp(u)du  ■  <-l)pp!  j  -  p 
P  3  -  r. 

Purtheraore,  if  Kp  is  a  function  satisfying  (2.3),  than  thara 
exists  a  p-tiaes  diffarantiabla  function  K  satisfying  (2.2) 
with  K(p)  -  Kp. 


A  kernel  satisfying  (2.3)  with  a  finita  M  0  is  taraad  a  kernel 
of  ordar  (p,r).  Tha  rasult  for  tha  expansion  of  MSB  is  now  stated. 


Thaoraa  (2.3)  —  Gasser  and  Muller  (1984) 

Let  g  be  an  r-tiaas  differentiable  function  on  [0,1]  and  r  2t  p+2.  Let 
g(r>  be  continuous  at  a  point  a  in  (0,1).  Lot  tha  Lipschitz 
continuous  karnal  Kp  be  a  kernel  of  ordar  (p,r)  with  support  [-L,L] 
and  suppose 

(i)  h  — *  0,  nh  — »  •,  as  n  — ♦  •,  and 
(ii)  aas]  Isj-Sj.x-U/n)!  -  0(n-*),  8  >  1. 

Than  for  a  in  [h, (1-h)]  and 

g£p)(a)  -  (l/h**1)  y(ax)  Kp[(a-u)/h]du, 
where  At  is  defined  in  (1.4),  we  have 

W»[«iP)(«)I  -  B[gip)U)-»<p>(a)]2 
-  (aVnh2**1)/^  Kp(u)adu  ♦  (h2<r_p>/(Pl )a)[/_i  ur  Kp(u)du]ag(r)(a)a 
♦  0[<l/nah2p+1)  ♦  (l/nV^1)  ♦  (l/nh2^2)]  ♦  o(h2<r'p>).  (2.4) 
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An  asymptotically  optimal  local  bandwidth  nay  ba  obtained  in  the 
usual  Banner  by  solving  for  the  critical  value  of  the  leading  terns 
of  (2.4),  regarded  as  a  function  of  h.  The  authors  obtain 

hopt(a)  -  C  n-1/<2r+1),  (2.5) 

where  C  is  a  constant  depending  on  p,  r,  a2,  Kp,  and  g(r>(x).  Upon 
insertion  of  this  bandwidth  into  (2.4),  the  rate  of  convergence  of 
the  USE  is  obtained: 

MSB[g<p)(x)]  *  C*  n-2<p-p)/<2r+1>  +  o(n-2(r-p>/(2r+1>) .  (2.6) 

The  quantity  C*  depends  on  the  sasM  quantities  as  C  in  (2.5).  In 
(2.6)  observe  that  the  rate  of  convergence  gets  rapidly  worse  if  one 
desires  to  estiaate  g(p>  for  increasing  p.  The  bias  rate  Bay  be  kept 
constant  provided  r-p  stays  constant,  which  forces  a  larger  value  of 
r  and  aaounts  to  an  assumption  of  greater  saoothness  of  g.  Even  so, 
the  rate  of  the  variance  still  gets  worse  for  increasing  p.  The 
higher  the  value  of  p,  the  greater  the  value  of  the  local  bandwidth, 
at  a  cost  of  increased  bias  and  aore  pronounced  boundary  effects. 

If  one  desires  to  choose  a  bandwidth  which  minimizes  a  global 
measure  of  error,  then  me  any  choose  h  to  minimize  the  aaan 
integrated  squared  error  (MISE),  or  an  approximation  thereof, 
unfortunately  the  MISE  aay  be  dominated  by  the  boundary  effect,  that 
is,  bias  which  arises  whenever  one  estimates  g(p)  near  the  endpoints 
of  the  range  of  interest.  Bias  near  the  boundary  usually  contributes 
heavily  to  the  MSB,  unless  the  function  g  happens  to  be  saooth  at  the 
boundary.  Since  our  weights  are  of  kernel  fora  and  depend  on  a  single 
bandwidth  parssieter  selected  to  serve  well  over  the  entire  interval. 
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som  Modification  of  h  and/or  K  say  ba  nacasaary  to  downweight  tba 
contamination  which  arisas  naar  tha  boundary.  It  is  wall-known  that 
tha  rata  of  convarganca  of  tha  MSB  at  a  point  naar  a  boundary  is 
of ton  slowar  than  at  an  intarior  point  of  astiaation.  To  circumvent 
this  difficulty,  Gassar  and  Miillor  (1984)  choosa  to  nodify  tha  karnal 
Kp,  obtaining  "boundary  kornali”  which  ara  uaad  whanwvar  ona 
estimates  within  a  bandwidth  of  aithar  boundary.  Thasa  aodifications 
raquira  now  karnal s  satisfying  car tain  moment  conditions.  Contrary  to 
som  appoachas  takan  by  othar  authors,  thasa  Mthods  do  not  altar  tha 
original  karnal  by  truncation  or  bandwidth  shrinkage.  Tha  boundary 
kernels ,  not  necessarily  nonnegative,  arise  from  tha  solution  of  tha 
variational  problem  of  MXSE  minimisation,  considered  as  a  functional 
of  tha  kernel  in  tha  KISS  aspen t ion.  the  resulting  kernels  turn  out 
to  ba  relatively  siaple  low-order  polynomials. 

Bardie  and  Gassar  (1984)  consider  robust  estimation  of  g(1>  with 
an  approach  based  on  N-astimation  (Buber,  1981,  Ch.  3.2).  Khan  using 
an  estimator  which  acts  as  a  linear  operation  on  tha  data,  such  as  a 
karnal  estimator,  single  outliers  might  mimic  peaks  and  troughs, 
corresponding  to  unexpected  zeros  in  tha  estimated  derivative.  Tha 
authors  note  that  astiaation  of  derivatives  is  likely  to  ba  more 
sensitive  to  outliers,  and  hence  robust  methods  are  often  called  for. 

Georgian  (1984c)  considers  direct  estimators  of  g<p)(x),  which, 
in  his  notation,  replace  tha  quantity  Kp  in  (1.5)  with  Kp  r,  a  karnal 
which  satisfies  similar  moment  conditions.  Thasa  results  ara  similar 
to  thosa  of  Gassar  and  Nullar  (1984),  but  use  kernels  vbote  support 
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is  [0,1]  rather  than  [-1,1].  Another  ainor  difference  In  the 
estimator  1«  the  usage  of  -  [xt.x,xt]  rather  than  At  •  [st_lfst]. 
Also  a  reversal  of  the  order  of  the  Integrand  arguments  of  (l.S)  does 
not  lead  to  a  factor  of  (-l)p  when  the  kernel  weight  is 
differentiated. 

The  estimator  considered  is 

g£p,(»>  -  (l/hp*1)  rj.x{  y(xA)  fMi  Kp  r[(u-«)/h]du  }.  (2.7) 

He  state  the  following  theorem  to  afford  a  comparison  between  the 
approaches. 


theorem  (2.4)  —  Qeorgiev  (1984a) 

Let  r  >  p  he  a  fixed  integer.  Assume  KpfX.  is  a  real-valued,  hounded, 
and  continuous  function  on  (0,1)  which  vanishes  outside  (0,1).  Also 
assume 

(i)  /  u3  Kp#r(u)du  »  jj  for  3  »  p 

0  for  j  a  p,  3-0,i,...,r-l* 

(ii)  0.s0Si1<...<^i«#tl-i, 

(iii)  h  — ►  0  as  n  — *  •, 

(v)  *  ■l(«1il.l)  .  0(l/n). 


w<oTi)  I*  *<■>  -  •(>)<«>l  ■  <Kh*-»  ♦  l/ofc>). 
hrtkmm,  if 

(▼1)  *jit  i«  Up>drit»  Bitlwi  of  or* or  •  >  0, 

<*ii>  *[•*(%)]  f  •*  <  •,  «* 

(▼111)  h  -  (1.0) 


«•<?!)  *tlip,(»)-»(,>(»>3*  • 


tailor  (1M4) 


3.  IK 


15 


«fcar«  oJp>00  !• 


f[fip)<«>l  *  *Clip>(*)-f<,> <*)]*. 


ot  t{*)(m)  with 


oJp>(b)  -  (1/fcP*1)  /&tlt[(B-«)/h]iB  }.  (3.1) 


f(Bi)  -  (!/■)  Xj.x  7a(*t>l  *i  ■ 


■o  “  0#  *»  •  1*  *i  *  *i  0  *i*i* 


Bill 


iatlwiv 


31<*j)*  f(Bj)  ♦  •!(>))) 

1  ■  If J  ■  1# ••♦»■! 
l[i^(ij)]  ■  0»  B^f.*.*^  MtnlMi 
•av(«t(Bj)f«k(B4)]  • 


(3.3) 


T  H 


to  to  OTto  with 


t(0)  -  l.  i» 
If  It  Bin 


to  v  *•  • 

if  ato  «()>f  i  •  0, ...ft.  Wto 

Of  w  toll  to 


J 


tko  ■wiry  tool*  to  focllltoto  tbo  proof.  9m  foUowAot  too  1mm 
will  bo  ooof  la  tbo  ronlt  for  oogaptoUe  oorioaeo. 


UBLlltU  lot  Tte  Upocblto  ooatlaooM  aad  aoppooo  for  aaeh  a, 
*u«  *  *  *>*m  m  orior of  portitlM  of  fiaod  iooi«a  polatp  on  [0,1] . 
Lot  ob0,...,oW|  ootlsfy 

■a.i-i  ^  Hi  *  Hi*  4  •  4»  ••••*» 

oboro  -  0  oaf  tta  tboro  oaloto  aoao  •  >  0  for  Midi 

H,H  i  0  i  pad  K.t.i 

BMC1  if  tao  Upoablta  noafifloo,  tboro  oalata  ppm  »"  >  0  for  ohieb 

lT<d*i-*»j)-T(^i)  I  *  »"|(a-1-a,j)-(o-«>| 

*  •*  [|aia-o|*|a1|J-o|] 

*  •*  C<HrVw>*<«.rVi-»>l 

t  •  [l'w{(ill-aa(t.1)i{iljaiai 
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11  11  Ut*>  0  tout  i.  (o.i).  Let  p  b«  a  ottin 

‘“*"r  “*  "*"•  *>l,“  ■•““•U'  lonowtu  tmetUm 

«**■.  (-1,1).  corr^uc.  fMetiai.  — — 

J‘  *  *"*"*  '»'•  T<M)  V<«-»/h)^((r'V>AJ«Mr.  (J.J) 

®“  **  *  ■  "<*>  MftU,  J,  .  J„  MMC, 

Mow  (J.3)  (Witts  site*  t  it  rnniltH  n  - - - 


. . . "  7  “  «**,*•  okoolw«i r 

^  •  *  <— >*  —  t  -  (,-*)/h,  tk.  —  in  i, 

<*.J)  «qr  kt  vrittw 

*  *"*  Ch*  1,1,  v[(t-t)k]  K,(«>i,(t)4ait}, 

*****  1  *  C(*-l)/k,«/fcJ  «t»M  C-l,lJ  for  k  mu  «MMgk,  ttm 
rmmlt  follow. 


!•  k*. 


w  itata  • 


r 


t 

it 


» 

» 

i 

♦ 

i 


9m  for  »JP>(«)  trfiMf  fer  (3.D. 

■(•^(a))  -  (!/)*>  /-i  «UH»)  X,(”>*  ♦  OO/rtP) 
-  /.i  f(p) (»-*»)  X(a)4o  ♦  OU/ohP). 


mo  aro  mem  road?  to  prow*  tho  ml*  rooolt  of  tfeii  Motion,  for 


ftp)  Mtiantor  (S.l)  la  Mtol  (J.t).  lot  X  •  K,  M  i  horaol 

fooctloa  with 

(i)  *(•>  •  x(-«>  With  o*fort  t-l.ll. 

(11)  /  s(o)io  -  1  (K  Mr  ho  ootntlM). 

(Ill)  E,  -  *<r>  oMot,  aro  taM,  Mi  Mli 

oof iM  (-1.1]  for  r  -  0.1... ..pi  ami 
(It)  I'd)  -  «,<-!)  for  r  -  ,p-i. 

that  lo. 

<*)  r  MtlOClOO  «M  Muff  la  (1.7),  Mi 

(ol)  |t(o)  -  t(t)|  i  »|o  -  t|,  omo  tat. 


<*u)  |*mi-«1|fl.x|  -  <xi/a), 

Car  tte  ratrauiaa  taaetiaa  «, 

(alii)  f(,)  arirti  far  r  ■  i,...,p  mC  f(,) 
if  cwaMaaoaa  ok  a. 

Smm  Cor  h  •  (y(l  -»  0  af  a,a  -»  •, 

(•)  *fr[«£”(a)]  •  (c*/hh*)  I  (hyp)  4  o(l/aab*),  ehore 
«h»p)  -  rl(»-t)h]  K,(f)K,(t)4e*t; 

(b)  Maf*(«<»(a)]  •  h^hip)  4  o(l/tif)  4  ou/h’h*), 
aim  Khyp)  •  /.J  ^’’(aHaO  K(a)da  -  f^(a)|  wC 
(e)  Ml^d)]  -  thrive)]  4  Bias* (a)] 

•  (c1/**)  X(hyp)  4  l*(hip> 

4  o(lAhP)  4  4  0(1/B*h*) . 

Ut1  ■»»  <«>  if  trivial  «m  (a)  t*4  (b)  ara  cfhlt«cf.  a 
that  (b)  iftloaf  iaaoAiataly  free  uaaa  ().))  oaC  the  faat  th 
if  ofatiaaaaf  at  a.  me  prat t  of  (a)  «1U  rijflre  (i)  -  («u) 
for  (iv).  aritiaf 

*£><•)  •  OAT1)  C»[(B-e>/h)«e( 

it  ia  clear  that 

ferh^Ca)}  •  (c*A>  It*,  eft*  (a)  a£f*(a)  t<aBl-allj). 
Owftar  (J.«)  la  kmm  (1.1)  oai  let 
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• f  U«a  (3.2),  with  h  sufficiently  snail  (depending  on  x), 
|wnrt«<p,<x>]  “  <«a/*hap)X(hip)| 

-  |war[f<p)(x)]  -  (ffa/n)Jj| 

•  |sar[«£p>(x)]  -  (*a/n)Jxj 

•  C  |Z1Z]  T<«ai“«Bj)  Kp[(«-o)/h]Kp[(*-v)/h]dndw 

-  /J/o  Zp[(«-tl)/h]Kp[(*-V)/h)dBdv| 

•  C  IZjZj  t7(«Bi-«Bj)-7(u-w)]  Kp[(*-a)/h]Kp[(m-v)/h]dudv| 

<  iCD*  /q/o  I  **K«-«>/hl  Kp[(x-e)/h]  |  dudv 

•  *a)n  {  J$  |«t[(«-ti)/h]|dn  I*.  (3.5) 

the  last  iaoqeality  by  Um  (3.1).  By  a  change  of  variable,  tho 
integral  in  (3.3)  is 

h  ik  |K,(v)|dv. 

■sw  a  -  [(n-l)/h,«/h3  contains  [-1,1]  for  h  snail  snoogh.  No  thsn 

Nalt^OOl  -  (»a/^ap)  I(h|p>| 

•  aa^  b*  {  /_t  |ip(w)  H»v  }% 

••*»{/.!  |K,(w)|*r  )* 

•  Od/nb1*),  as  a,  n  — •  h  — •  0, 


B„  •  0(l/a). 
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4.  fxpanslon  of  MSB  for  Arbitrary  Ordar  p 

In  this  taction  tho  goal  Is  to  obtain  an  asyaptotlc  aapanslon  of 
MSl[g<p><*)],  where  g£p)(x)  Is  given  by  (3.1).  Na  will  naad  to  expand 
Khjp)  and  B(hfp)  undar  snoothness  assuaptlons  on  g  and  y,  enjoined 
by  appropriate  Taylor  series  ragulramts.  Properties  of  the  kernel 
function,  K,  are  iagnrtant  whan  evaluating  these  expansions.  Me  will 
usually  at  suae  that  X  satisfies  the  orthogonality  properties  of 
Gasser  and  Muller  (1984) . 

First  we  set  about  defining  notation  useful  for  the  evaluation 
and  representation  of  ooxnonly  recurring  terns.  Me  define  the  sonant 
notation  i 

tfjtK*)  •  J.j  uJ  Xr(u)du,  (4.1) 

whidi  is  the  jth  nonit  about  the  naan  (zero)  if  X,  happens  to  be  a 
■jpeulrlc  probability  density  on  [-1,1].  For  X  »  Kq  we  will  require 
syenetry  and  ^(Kg)  ■  1,  but  allow  negativity. 

A  notation  will  bo  needed  to  handle  bulky  double  integral 
expressions  which  arise  in  certain  variance  expansions.  Define  for  a, 
b,  t  in  [-1,1],  r  ■  0,1,...  the  notation  (4.2),  with  special  cases 
(4.3)  and  (4.4)i 

X(r,pia,b)  -  (s-t)r  Kp(s)Kp(t)dsdt)  (4.2) 

C(r,p)  •  K(r,pi-l,l)  -  K(r,pit,l)  ♦  X(r,pj-l,t)j  (4.3) 
D(r,p)  •  X(r,pft,l)  -  X(r, pi-1, t).  (4.4) 
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Using  the  blncnlal  sapanslon,  vs  r slats  (4.3)  to  (4.1) i 

C(r,p)  «  £j.0  ( j)(**l)Vj(Kp)*sr_j(Kp)  •  (4.5) 

Further  simplification  of  (4.5)  is  posslbls  bp  noting  rscurslvsnsss 
and  conditions  for  which  tarns  (4.1)  vanish. 

Suppose  SjOlr)  aslsts  for  r  ■  0,1, ...,p  and  I,  ■  K(r>  is 
tha  rth  derivative  of  an  avan,  p-tiaes  dlffarantlabla  function 
K  •  Kq  *  K(0).  Than  for  a  givan  r  -  0,1, . ..,p, 

Mjdtc)  -  0,  if  j+r  is  odd.  (4.6) 

Furthermore,  if  Kp_1(l)  ■  Kp_1(-1)  -  0, 

<*j(Kp)  -  (-j)-MJ_1(Kp.1>,  3  >  0,  and  (4.7) 

«j(Kr)  -  0  if  r  >  j  h  0. 

Proof i  Iquation  (4.6)  follows  sines  (4.1)  is  an  integral  of  an  odd 
function  over  [-1,1]  whan  Kg  is  svan.  To  obtain  (4.7),  integrate  bp 
parts.  ■ 

This  result  causes  tranandous  simplification  of  (4.5)  since  at  least 
half  of  the  tarns  will  vanish  (evarp  other  tarn  drops  out) .  Our 
taplor  swiss  tools  will  be  suanarisad  in  tha  nest  lease.  This  lsana 
has  base  tailored  to  neat  our  needs,  since  expansion  will  alwsps  be 
about  saro  and  tha  aryant  will  approach  saro  bp  assuaption.  Ivan 
functions  and  one-sided  expansions  will  be  takan  into  account. 
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L«t  f  bt  a  mil  continuous  function  defined  in  a 
neighborhood  of  the  origin  M:(-t,t),  t  >  0.  Lot 

(i)  f<3),  j  -  if...fn  exist  and  bo  continuous 
in  V  and  lot  f<B*l>(0)  axist. 

Than,  as  u  — *  0, 

(a)  f(u)  -  f<k)(0)  uk/k!  +  o(uB*x). 

Furtharaora,  if  r  *  [  greatest  integer  £  (n+l)/2]  and 

(ii)  f(u)  -  f(-u), 
than,  as  u  — »  0, 

(b)  f(u)  -  l£_0  f<2k)(0)  u^Alk)!  +  o(u2r).  («-8) 

Finally,  if  we  replace  (i)  with 

<i)'  f(j),  j  ■  1, ...,n  exist  and  are  continuous  in 
M-{0>  and  f<n*x)«H)  and  f<B+1)(0->  exist, 
than  assuring  only  (i)'  with  u  in  [0,t)  and  u  — *  0*, 

(c)  f(u)  -  l?*o  «U)<0+)  uk/kl  ♦  o(uB+1). 

For  u  in  C-t,0]  and  u  — *  0", 

(d)  f(u)  -  f(k>(0-)  uk/kl  ♦  o(uB+1).  (4.9) 

Under  (i) '  and  (ii)  with  k  even, 

(e)  f<k>(0-)  -  f(k>«H),  (4.10) 

nhigh  wa  will,  with  an  abuse  of  notation,  denote  f<k>(0). 

(Technically,  this  derivative  nay  fail  to  aaist  by  the  definition, 
but  we  will  adopt  this  notation  convention  whenever  the  right-hand 
and  left-hand  derivatives  at  a  point  are  the  seas.)  For  k  odd, 

(f)  f<k>(0-)  -  -  t(k><0*). 


Proof:  Assertions  (a)  and  (b)  are  standard  and  follow  fron 

Fulks  (1969,  p.160).  Assertions  (c)  and  (d)  are  lesser  known  and  are 

adapted  fron  Fulks  (1969,  p.160). 

to  obtain  (e)  and  (f),  note  that  (ii)  oscillates  between  an  even 
and  odd  function  on  each  successive  differentiation.  Using  the 
assuaed  continuity  of  the  derivatives  in  (i> ' ,  we  have,  for  k  even, 

f°°(t)  -  f<Il>(-t). 

Letting  t  — *  0+  produces  result  (e).  Similarly  we  Obtain  (f).  ■ 

Recall  that,  under  the  conditions  of  Theorem  (3.1), 

Var[g<p)(x)]  -  (e2/mh2p)  I(h|p)  +  0(l/mnh2p),  (4.11) 

where 

Kh;p)  -  7[(s-t)h]  Kp(s)Kp(t)dsdt. 

Under  two  situations  for  the  smoothness  properties  of  7,  we  will  now 
derive  respective  expansions  of  (4.11). 

Theorem  (4.1)  Suppose  7  is  a  correlation  function  satisfying  (1.7) 
and  (i)'  of  Lemma  (4.2)  (with  n  ■  q  2  1  as  the  order  of  smoothness). 
Then,  under  the  conditions  of  Theorem  (3.1), 

Var[g<p>(a)]  -  (o2/m)[S0  +  Sx  +  o(h‘*+1'2p)]  ♦  OU/rnnh2**),  (4.12) 

where 

So  -  !$.<>  7<It><0)  C(2v,p)  ha(T“p)/<2v)!, 

Si  -  l£.0  7<*^W(0+)  D(2v+l,p)  h2<T^)*1/(2v+l)l, 
a  ■  b  -  q/2  for  q  even,  and 
•  •  <q+l)/2,  b  ■  (q-l)/2  for  q  odd. 


The  constants  C(2v,p)  and  D(2v+l,p)  ara  da£lnad  by  (4.3)  and  (4.4), 
raspactivaly.  Furthermore,  it  y  has  more  saoothnass  at  tha  origin, 
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that  is,  y  satistias  (i)  of  Laoaa  (4.2)  rathar  than  (i)',  than  (4.12) 
still  holds  with  Sx  -  0. 

Proof:  Let  h  — »  0.  Let  y  satisfy  (1.7)  and  (i)'  of  Laaaa  (4.2). 

Observe  that  (ii)  of  Lenaa  (4.2)  is  autoaatically  satisfied  for  a 
correlation  function.  We  have  for  s  >  t, 

Tt(s-t)h]«  r(1)(0+)  (s-t)1  h3/3*  ♦  cXh^1), 
and  for  s  <  t, 

7[(s-t)h]  -  7<3)(0-)  (s-t)J  hVj!  ♦  o(h^). 

Bring  in  l(h;p)  ■  Ix  +  I2,  where 

lx  -  ^\s\  7t(s-t)h]  Kp(s)Rp(t)dsdt,  and 
l2  -  7t(«-t)h]  Kp(s)Kp(t)dsdt, 

so  that  by  notation  (4.2), 

Ii  -  7<3)(0+)  K( j,p;t,l)  hVj!  +  (4.13) 

I2  -  7<J>(0-)  K(j,p»-l,t)  h3/jl  ♦  O(h^).  (4.14) 

Goobining  (4.13)  and  (4.14),  we  see  that  the  coefficient  of  h3/j!  is 

7<3)(0+)  K(j,p;t,l)  +  7(3>(0-)  R(j,p;-l,t).  (4.15) 

When  considering  (4.9),  (4.10),  (4.3),  and  (4.4),  expression  (4.15) 
bacoaes  7<J)(0)  C(j,p)  whan  j  is  even  and  7(3)(0)  D(j,p)  idien  j  is 


odd.  We  now  have 


I(hjp)  -  sl  +  s[  *  oiti**1), 
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where 

-  I^o  T(2v><0)  C(2v,p)  h2v/(2v)l 
Si  -  rS-o  7<2v+1)  (0+)  D(2v+l,p)  h2v+1/(2v+l)!, 
with  a  and  b  depending  on  whether  q  is  erven  or  odd.  The  values  for  a 
and  b  follow  froai  Leon  (4.2).  The  conclusion  (4.12)  is  obtained  by 
aaking  use  of  (4.11). 

For  saoother  7  satisfying  (i)  of  Lsbbb  (4.2),  we  use  (4.8)  to 
conclude  that,  for  any  s,  t, 

7[(»-t)h]  -  X£_0  7<2v)(0)  (s-t)2"  h2v/(2v)!  +  o^1). 

There  is  now  no  need  to  break  Kh;p)  into  two  pieces.  Ne  are  led  to 
the  expression 

Khjp)  -  Sg  ♦  ©(h***1), 
froB  which  the  second  conclusion  it  clear. 


To  obtain  an  asyeptotic  MSB  expression,  we  will  need  to  consider  the 
bias,  which  under  the  conditions  of  Leans  (3.3)  any  be  written 

Blas[g<p)(x)]  •  B(htp)  ♦  0(l/nhP),  (4.16) 


where 


B(hjp)  »  l_{  g(p,(x-hu)  K(u)du 


g(p)<x) 


1 
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Sheorssi  (4.2)  Let  p,  r  Im  nonnegative  integers  such  that  r  2  p+2. 
Suppose  that  g  is  an  (r-1)  tines  continuously  differentiable  function 
and  that  g(r>  exists.  Also  suppose  K(u)  »  K(-u)  and  K  satisfies  the 
assuaptions  of  Lewi  (3.3).  Then  as  h  — »  0, 

Bias[g<p)(x)3  -  t$ml  g<p*23)(x)  u^O^)  h23/(2J)! 

♦  o(hr"p)  ♦  0(l/nhp), 

where  c  ■  [greatest  integer  £  (r-p)/2]  and  ia  ®iven  by  (4.1). 

Proof:  now  for  j  ■  0,1, . . . ,r-p, 

[d3/dh3]  g<p)(x-hu)  »  (-1)3  u3  g<3*p>(x-hu), 
which  evaluated  at  h  »  0  b access 

(-1)3  u3  g<34p)(«>. 

Using  Laana  (4.2),  an  expansion  of 

♦(h)  -  /_}  g<p,(x-hu)  K(u)du 
becoaes  (with  h  — *  0), 

♦(h)  -  Zfcl  ♦U)(0)  hk/k!  ♦  o(h*“p) , 

where 

*<°>(0)  -  g<p)(x)  «<,(*<,)  -  g<p)(x), 

*«)>(0)  -  g(p*23>(x)  ej^Ko),  j  -  1, . • . ,c,  and 
♦U3+1>(0)  -  -  g(p+23+1)(x)  naj^CK,,)  -  0. 

The  last  statement  follows  froai  Laaaa  (4.1).  therefore 

B(hjp)  -  ♦(!»  -  g<p>(x) 

-  Z|.x  g(p*23)(x)  eai<*o>  h23/(2J)l  ♦  o(h*-*), 
fro*  which  the  conclusion  is  ianodiate  by  using  (4.16).  ■ 
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Wa  ora  aow  in  •  pot  it  Ion  to  omMm  tho  rtwlti  iato  oar  aaia  reoolt 
for  tho  ofiior  of  tho  MM.  koto  haws  o  siaflo  poiat  of 
roferoaco,  wo  will  explicitly  itoto  oil  assoaptioas  woof  io  tho 


lhaoraa  (4.3)  lipyon  for  o  fiwoo  p  ■  0,1,...  it  is  ioolroi  to 
ootiaoto  ot  o  point  x  io  (0,1)  osiao  *Jp>(s)  of  0.1)  la  tho 

oocrolatod  orroro  aortal  0.2).  Soppooo  7  is  a  tipochitx  ooatiaaooo 
oorrolatioo  faaetioa,  that  it, 

(hi)  t  satisfioa  tho  eoaditlcao  la  (1.7),  aart 
(02)  |t(«)  -  7(f) |  *  »|«  -  t|,  mm  1  >  0. 

7  aloo  satisfios  oithor  (03)  or  (03)’  i 

(03)  7<j>*j  •  oaist  aart  aro  ooatiaoowa 

ia  (-t,t)-{0},  for  ooao  t  >  0,  aart  7<J>(0*-), 

7(1,<0-)  oaist  for  J  ■  1, ...,q+l. 

(03)’  7(1>,  j  *  l,...,q  oaist  aart  aro  ooatiaooos  ia 
(-t,t)  for  soao  t  >  0  aart  7<t*1)  aaists  for 
aoaoqh  l. 

osswao  «  •  t <0>  is  a  foaetioa  oh  ora 

(11)  §<J>  waists  aart  is  coatiaaoos  for  j  •  1, ...,r-l, 
aart,  «<r>  aaists; 


(12)  r  h  p+2 


2* 


K<#)  ba  a  km 1  fmetim  with  Miari  to  ho 

Rj  •  *<J>.  J  •  0,1....  aw*  that 

<a>  R,  *Uti  mi  la  ImM  with  impart  [-1,1], 
j  •  0,1,2, ... 

<C2)  Rg(a)  •  R^-a)* 

(C3)  /.J  Kv(a)*i  -  1) 

(C4)  Kj(l)  •  Rjt-l)  -  0,  j  •  0,...,p-l. 

(Dl)  «■%  l«w“V  w|  •  0(l/h). 

Umb,  oaiwr  (AS)  with  h  -»  0, 

-  <•*/*>  [Sq  ♦  »i  ♦  ©(h**1-*)]  ♦  Od/aah*) 

♦[»  ♦  o<hr_»)  ♦  oa/«h»)]1, 

*0  -  c*  t<1,r>(0)  C(2v,p)  A*<^V(2w)|, 

*!  •  t<*-”<0*>  0<2w*l,p)  *«»-»>*V<*r»l>l, 

with 

a  -  (trmtoat  lota— r  t  <f»l)/t], 
b  •  a  if  q  la  aaoa,  b  »  a-1  if  %  la  aMi 

C(2w,p)  ■  I.J/-1  <a-t>*  R,(a)R,(t)4oit, 
*j<V  -  /.}  a1  lp(a)4a, 

D<2w*l,p)  -  /.}lt  l^(a>lp(tMMt, 

-  <a-t)*r*1  lp(a>lp(t)irtt, 

1  *  *J-i  v<p»aj>(||)  Hi(S9)  h*V(2J)l,  mi 
«  •  [mamma  lahpi  <  <*-*>/!]. 


(4.17) 

(4.10) 


u 


at  CGr.p)  la 


□□CSS 
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■a*a«  *,(»»)  -  I.J  a1 

KtUMa 

> 


vita 


■Iianiiii  (AS).  (AS)*  wir^l  tm  mmMttm rmtUkU  aa* 

AUtara atlaMa  t  A  da  arl«U,  rMpattlwly.  Mr  oamUM.  tfcaaa 


T 


T» 


(4.J)  an 


A 


»  •  1.1. 


r  ■  p*l  aa  tha  laaat 


at  Aarlaatlaaa  af  «. 


p  •  1,  «  •  1,  »  -  1. 


(1.1) 


(a)  ■■(«£”(«)]  •  Vj/Mi  ♦  V*  4  o(VW  ♦  CKl/aob1) 

♦  bjb*  ♦  #<b4}  ♦  o<l/ab)  ♦  OO/bV), 

<imi  Mia*  anti—  (4.1)  «i  (4.4), 

*!  -  Tu,(0*)  a1  Ml,!),  tor  paM  t 
0,  for  ■BOOM  Tl 

-  -  t<a,(0)  f1,  ai  b,  •  («<*>(m)  ^(Ko)/!]’. 

•w  »•*•<•*•  r  •  4,  aa  kaa 

(b)  NMt«£a>(B)]  ■  Vj/bb3  ♦  v^/m  ♦  v^/m  ♦  o(l/a)  ♦  0<  1/Mb*) 

♦  bjb*  ♦  o(b*>  ♦  ocJ7Ma)  ♦  OU/»V)  ♦  (Kl/a),  (I.S) 

ban,  oo&af  aotatlM  (4.1)  oai  (4.4), 
wx  •  Tu>(0»)  **  0(1,1),  for  pooboi  y 
0,  for  — oU  t) 

*,  •  t<a>(0*)  •*  D(3,l)/4,  tor  poabai  y 
0,  for  Moatb  t» 

▼j  ■  7<4>(0)  •*,  oai  b|  •  lf<4,(a)  »(le)/2]>. 

bavo  o  •  ((f»l)/a]  ■  l,  so  that 

>o  •  I**  T<a,r>(0)  C(Sv,l)  b*<4"l>/(*r)l.  (I.S) 

Boo  frM  VMlo  1,  C(0,1)  -  0,  C(l,l)  •  -a,  la  MUb  oaoo  (I.S) 
ol^llflM  to 

>0  •  -  T(,1(0). 

II  boo  f  li  oM,  b  •  o-l  •  0,  oai  ao  obtala 

t,-C  t<#,*l)(o*>  »(ao*ifi)  b*<4"1)4l/(ir*i)i 
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whenever  the  correlation  function  li  snooth.  Observe  that  if  it  is 
possible  to  choose  the  the  kernel  such  that  D(l,l)  ■  0,  the  sene 
redaction  in  variance  is  achieved  and  the  estimator  has  the  sane 
asywptotic  MM  for  either  type  of  correlation  function. 

an  eneaple  of  a  anooth  correlation  function  (i.e.,  one 
differentiable  at  the  origin)  is 

T<u)  ■  enp{-*2/0}.  (5.4) 

Let  f (a)  be  a  syanatric  probability  density.  The  characteristic 
function  (u)  ■  [elttm]  is  thar afore  real,  positive  definite,  and 
has  the  property  *t(0)  »  1.  Ibis  observation  loads  to  a  convenient 
aannar  for  generating  a  class  of  correlation  functions  which  have  the 
desired  snoot hness  properties. 

another  question  of  interest  is  the  conperison  of  Var[gB(x)]  and 
Mr[g£l>(«>]  in  the  case  of  a  saooth  correlation  function,  rron  Bart 
and  Nabrly  (IMS),  we  have  oa/a  as  the  leading  ten  of  Ver[gn(*)]. 
Pron  (5.1)  the  landing  ten  of  var[g^1>(x)]  is  -  y<2>(0)o2/n.  Hence 
for  large  n,  the  variance  of  g£x>(x)  will  bo  saallar  than  that  of 
gB(x)  if  t(2,(0)  >  -  1.  this  result  differs  fron  that  in  the 
uncorrelated  case  where  «ar[gB(a)]/Var[g^1>(a)]  — *  0 
as  n  — *  •  and  h  — *  0.  m  the  particular  case  (5.4),  we  observe  that 
y<2>(0)  >  -1  if  #  >  2. 

the  aost  iaportant  and  iaaadiata  oonsoquancs  of  SMorea  (5.1)  is 
aaaa  sqaare  eoasistency.  As  reported  by  dart  and  Nabrly  (1M6)  for 
the  aaaa  nodal  with  p  •  0,  wa  find  that  there  is  a  lack  of 
noael stsarr  wnltr*  a  -♦  •.  No  neat  obssrvs  the  conditions  which  are 


sufficient  to  cause  tha  tarns  in  (S.l)  and  (5.2)  to  vanish 
asymptotically. 


36 


Theorem  (5.2)  As  sum  that  tha  requirements  of  Theorem  (4.3)  are 
satisfied  for  a  selected  order  p  -  1  or  2.  In  addition,  suppose  a  is 
in  (0,1). 

(a)  For  case  (a)  of  Theorem  (5.1),  assune  D(l,l)  *  0  for 
a  peaked  7.  Than  g*l>(»)  is  naan  square  consistent 
for  g(1)(«)  if 

(i)  h  — *  0,  (ii)  nh  -»  •,  and  (ill)  ah  -*  «. 

Zf  it  happens  that  D(l,l)  ■  0  or  7  is  smooth  at  0, 
we  have  instead: 

(i)  n  — ♦  »,  h  — *  0,  (ii)  nh  —*  -,  and  (5.5) 

(iii)  anha  -♦  «.  (5.6) 

(b)  For  case  (b)  of  Theorem  (5.1),  assume  D(l,2)  #  0  and 
peaked  7.  He  have  consistency  of  g<2)(a)  if 

(i)  a  -»  •,  h  -*  0,  (ii)  nh2  -*  -,  and  (iii) 
ah3  — ♦  •. 

In  the  case  that  D(l,2)  ■  0  or  7  is  smooth  at  0,  we 


(i)  a  -*  •,  h  -*  0,  (ii)  nh2  — *  •,  and  (5.7) 

(li«  *h4  —  (5.6) 
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Proof :  The  result  follows  by  direct  consideration  of  the  MSB 
expansion  in  Theorai  (5.1).  ■ 

In  the  above  theorea,  conditions  (5.6)  and  (5.6)  are  simplified 
by  the  slightly  stronger  assumption 

lia  inf  n/n  >  0. 

which,  when  used  with  (5.5)  and  (5.7)  imply  the  respective  condition 
(iii).  Of  course  it  is  still  possible  that  n/n  — »  0,  so  long  as  the 
convergence  is  not  too  fast;  Me  are  now  led  to  consider  how  one 
should  ideally  choose  the  local  bandwidth  in  an  asymptotic  sense.  The 
usual  approach  is  to  differentiate  the  leading  terms  of  expressions 
such  as  (5.1)  and  (5.2),  regarded  as  a  function  of  h.  One  should  take 
care  to  ensure  that  the  leading  tarns  are  actually  the  dominant  terms 
asymptotically.  These  are  the  terms  which  decay  to  zero  at  the 
slowest  rate  (under  the  assumptions  made)  and  hence  ultimately  make 
up  the  largest  portion  of  the  MSB  as  n,a  — ►  •.  Of  course,  for  any 
finite  sample,  a  solution  as  described  above  may  be  subopt iaml  due  to 
the  relative  sizes  of  the  constants  in  the  MSB  expression.  Moreover, 
the  situation  is  further  complicated  by  the  dependence  of  h  on  m  as 
well  as  n.  Me  observe  that  both  n  and  n  — »  •,  but  they  any  proceed  at 
different  rates,  to  be  complete,  we  must  therefore  specify  conditions 
for  the  behavior  of  n/n  as  n,a  — *  To  illustrate  the  arguments, 

consider  the  leading  terms  of  (5.1) t 

vx/nh  ♦  va/n  ♦  ^h*. 

Solving  for  the  minimising  h*  we  obtain 


(5.9) 
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h*  ■  c  n~1/5.  (5.10) 

For  this  choice  of  h,  the  evaluated  MSB  in  (5.1)  yields 

0(n"4/s)  +  0(n_1)  ♦  0(n_V3/5)  +  o(n-1a1/5)  ♦  0(n_2n2/5).  (5.11) 

10  guarantee  that  (5.9)  is  the  dominant  tarn  in  (5.1),  we  need  to 
ensure  that  the  corresponding  rate  of  convergence  a-4/5  is  the 
slowest  among  the  last  four  tarns  in  (5.11).  This  will  be 
accomplished  if 

aaa  {a"1,  n'V3'5,  n'V'5,  n'V/5}  -  o(n-4/5). 

He  observe  that  the  condition 

a/n  -  0(1) 

is  sufficient  for  this  purpose.  Under  this  condition,  bandwidth 
(5.10)  is  optima  aaong  all  bandwidths  satisfying  nh  — ►  •,  ah  — ♦  • 
and  h  — »  0,  as  in  Theorem  (5.2).  The  constant  c  in  (5.10)  turns  out 
to  be 

c  -  (v1/4bl>1/5, 

where 

Vj  -  7a)(0+)  o2  0(1,1), 

bx  -  [g<3)(a)  ajCKo)/!]3, 

and  it  is  assunad  that  7<l)(0+)  *  0.  Therefore  if  bx  *  0,  0(1,1)  *  0, 
and  r  is  peaked,  we  have  the  above  result.  Zf  0(1,1)  -  0  or  7  is 
smooth  near  0,  different  nathods  are  required  to  obtain  the 
asymptotically  optimal  bandwidth. 
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